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Executive Summa 



r 




This essay seeks to answer four questions about data we use every day in comparing higher education 
in the United States with that in other countries, particularly the 30 advanced post-industrial democracies, 
including the United States, that are members of the Organization for Economic Cooperation and 
Development (OECD). 



• Why does policy-support research and commentary seek to 
compare national higher education systems in terms of student 
participation and attainment? 

• What do we find when we start assembling all the numbers and 
tables addressing these markers that are produced by both 
international organizations and national statistical agencies 
and ministries? 

• Does what we find tell a story that helps all nations participating 
in the measurements address their primary objectives for their 
higher education systems? 

• If not, then what changes and additions to our international data 
gathering and comparisons would provide that assistance? 

While all countries produce data on their higher education 
system’s enrollments and degrees awarded, they do so in 
different ways, and sometimes with different definitions condi- 
tioned by language, culture, and tradition. On the surface, their 
data are often not comparable. The shaping of these data and 
the analysis of comparability is performed by four international 
organizations: the World Bank, UNESCO’s statistical unit, Euro- 
stat (the statistical agency for the 27 countries of the European 
Union), and OECD. This essay uses comparability data from 
all four of those sources, but focuses principally on the printed 
version OECD’s annual Education at a Glance , the document that 
is most often invoked by those who believe that, compared to 
other advanced post-industrial democracies, the United States is 



doing poorly and losing ground in higher education attainment. 
This essay confronts the negative propaganda about the compar- 
ative performance of the United States because the propaganda 
is problematic. 

Correcting Negative Propaganda 

The first piece of negative propaganda stems from the core table 
on attainment in the printed version of Education at a Glance 
2008. Critics either didn’t know how to read the core table on 
attainment in Education at a Glance 2008 or they knew how to 
read it but didn’t want to report what the printed document really 
says: 

• In the proportion of populations earning bachelor’s degrees 
or their equivalent, the United States ranked #1 among 30 
OECD countries in every age group except 25-34, where 
we ranked #2. 

Before OECD put up, online, another version of this table, those 
who bemoan our position in the higher education world chose a 
different column, on which to focus: one that includes associate’s 
degrees, where, indeed, we do not perform well. The reason is 
simple: other OECD countries that award what are called “short- 
cycle” degrees (Belgium, Canada, Denmark, France, Ireland, 
Japan, Korea, the Netherlands, and United Kingdom) have insti- 
tutions and programs devoted solely to that task and no other, 
whereas our community colleges have taken on a plethora of 
missions and student populations who are not degree candi- 
dates, and are under greater pressure to transfer students to the 
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four-year sector with or without associate’s degrees. And when 
you mix bad performance for associate’s degrees with top-of-the- 
line performance for bachelor’s degrees, you purposefully distort 
what happens in U.S. higher education and why. 

The second piece of negative propaganda used by critics of our 
higher education system is based on another table in Education 
at a Glance 2008 that purports to display graduation rates (tech- 
nically, “cohort survival” rates) for those seeking a bachelor’s 
(or equivalent) degree. There are 24 OECD countries compared 
in this table, where the U.S. graduation rate is indicated at 56 
percent within six years of entry to higher education, the second 
lowest among the 24 countries. What OECD does not tell the 
reader is that: 

• The U.S. graduation rate is the only rate among the 24 to be 
calculated only if students graduated at the same institution 
in which they began. All the other countries present system 
graduation rates. 

• When we submitted a system graduation rate, i.e., you are 
counted no matter where you graduated — not 56 percent but 
63 percent — it was buried in an appendix to Education at a 
Glance 2008 that is only available online. 

• In that appendix entry, our data were dismissed as “old,” 
even though seven other countries in the table used the same 
starting year for their calculations. The fact that “1995-96 
for a starting date is acceptable for Sweden, for example, and 
not acceptable for the United States is a mystery. 

There are many other problems with this presentation, and the 
essay demonstrates considerable divergences between OECD 
graduation rates and the same rates found in the publications 
and on the Web sites of national statistical agencies. 



Economics and Demography 

The second part of the essay deals with two critical frameworks 
for justifying, shaping, and interpreting comparative higher 
education data. The review of the economic literature 
concludes that: 

• No simple relationship between education and economic 
growth can be isolated and defended. Educational attain- 
ment is a weak proxy, and we ought to be more modest in 
our claims. 

• Content and quality are missing from educational attainment 
data, and without these measures, the data are meaningless. 

• Even in the relationship between level of education and 
personal income there is a black box called “occupation” that 
must be accounted for, and this means post-degree history, 
something we rarely see in international comparative data on 
higher education. 

Demographics are the most under-rated factors in the presenta- 
tion and interpretation of comparative international data. And 
the most important demographic data for higher education 
lie in the age distribution of national populations, current and 
projected. The essay reviews the current and projected basic 
demographics (fertility, net migration, and growth rates) for 30 
countries, highlighting projections for the 25-34 age group in 
2025. It points out that: 

• The United States lives on a different planet from the other 29 
countries. Not only are we the largest ship in the harbor, but 
our population (denominator) is growing, while the popula- 
tions of most other nations will either remain flat or decline 
(in some cases, drastically) through 2025. 
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• One doesn’t need more than fourth grade mathematics to 
understand how population growth/decline will affect measure- 
ments of higher education participation and completion: 
countries with dramatically falling denominators (e.g., Japan, 
Russia, Poland) will see all their percentages rise; those with 
rising denominators (United States, Australia, Canada, and 
Ireland) will see all their percentages fall. 

• Hence, the #1 rank of the United States in the proportion of 
our population that has earned bachelor’s degrees will not last 
without radical interventions. Our coming fall will be a simple 
consequence of comparative demographics. 

What Do We Find When We Examine 
the Input Data and Markers? 

We find, first, a very complex and confusing international 
classification system for education programs called ISCED 
(International Standard Classification of Education) that is 
particularly baffling at the levels of the classification system that 
deal with both what is known as “tertiary” (higher) education and 
a level labeled “postsecondary but not tertiary.” While the ISCED 
system is under deserved revision, it still governs the presentation 
of international comparative data, and U.S. higher education 
officials cannot avoid learning about it and its dissonances, a 
number of which are illustrated. 

Second, the question of who gets counted, even when all nations 
submitting data are supposed to observe the same rules, winds 
up in fog: 

• “Beginning students” turn out, in some countries, to have 
previously attended — and even to have earned lesser higher 
education credentials than their current level of study. 

• Some countries (e.g., Canada) can’t tell anyone how many first- 
time students they have in their higher education systems. 



• “Graduating students” turn out to be whatever a country says 
they are. We find “expected success rates,” “survival rates,” 
and “completion rates” and are not sure what is what. 

• Some countries count “postsecondary but not tertiary” 
credentials, i.e., trade school certificates, as higher educa- 
tion degrees. 

• Constructs such as UNESCO’s “Gross Enrollment Ratio” are 
so poorly designed as to produce wildly inflated estimates. 

• The definition and counting of what we would call “foreign 
students,” a significant portion of enrollees and degree 
recipients in a number of OECD countries (e.g., Australia, 
France, Germany, the Netherlands, New Zealand, and United 
Kingdom), is highly variable despite international guidelines. 

In other words, there is too little meaning and too much variance 
in the credibility of these data. 

What do the International Reporting Organizations 
Do in the Face of This Variability? 

The international organizations responsible for comparative 
indicators are hardly ignorant of the problems they face in the 
variability of data they receive. They then valiantly try to reshape 
the data through templates based on artificial constructs, e.g., 
“notional age,” and formulas — “synthetic age ratio” and “virtual 
age cohort ratio” — that ironically only create more fog. For 
example: 

• In the matter of graduation rates, the formulas assume that all 
degree programs at a given level in a given national system 
are of the same theoretical duration. This approach decid- 
edly does not work when national systems offer three-year, 
four-year, and five-year bachelor’s degrees, depending on 
the field of study. 
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• It is difficult to say what the “ratio” results mean if the under- 
lying age bracket dynamics differ between countries that 
experienced population spurts (Ireland), dramatic expansions 
of their higher education systems (Finland), or temporary 
contractions of higher education systems when tuition was 
introduced (Austria). 

Synthetic and virtual ratios do not smooth out these bumps in 
the road. 

Slouching Toward Future Data: 

What Do We Have to Think Better About? 

Two large, related policy areas in every country are either obscured 
or missing from indicators of national educational attainment, 
and have to be on the docket for future incorporation: 

1. The role of secondary school structures and processes. 

A plurality of OECD countries have what we would call “tracking” 
systems in secondary education, under which student trajec- 
tories, some of which do not lead easily to higher education, 
are determined early. These tracks affect the way one should 
judge the through-puts of the higher education system, as 
they determine a “qualifying” population and a non-qualifying 
population that is subject to a different kind of analysis rooted 
in models of lifelong learning and potential later entry points 
through non-traditional routes. National examinations (prin- 
cipally high school exit; but, in a few cases, e.g., Portugal, 
Finland, and Japan, the principal determinant of college 
entrance) are of interest in terms of the way they sort and 
direct students within their national systems. The sortings of 
“qualified” populations are not dichotomous affairs: there is 
no question that students evidencing low levels of literacy as 
teenagers are considered truly “disadvantaged,” and require 
a different set of interventions than non-qualifiers who can 
later take advantage of second chance options. None of the 
current comparative educational indicators, though, illuminate 



the volume of those who take alternative routes into the tertiary 
system, and thus by-pass critical measures of inclusion. 

2. Looking for inclusiveness. The United States is not alone 
in seeking greater inclusiveness in higher education. Virtually 
all OECD countries look for underrepresented populations, and 
devise strategies to increase their participation in higher educa- 
tion. The definition and accounting for these populations, however, 
differs by world area, and sometimes, by country. International 
comparative data, then, appear impossible to construct. 

Analysts of U.S. higher education confine their representation 
questions principally by income and race/ethnicity. The reason 
for our concern with participation and completion rates for low- 
income students is fairly simple: there is a dollar sign on every 
college door, often followed by a substantial net price. In most 
other OECD countries (save Canada, Japan, and Korea), this 
cost is not an issue since tuition is either free or minimal. One is 
not surprised by high “access” rates in Finland and Sweden, for 
example, where tuition is an unthinkable concept. And because 
we are a nation of immigrants (most other OECD countries are 
not), in which the collective racial/ethnic minority population is 
on track to become the majority population, we naturally seek 
inclusion of discrete minority populations and track them closely 
in our national data. 

But the national data systems in the United States have some- 
thing to learn from the ways in which some nations pinpoint 
low-participating populations in higher education: by geocoding. 
Though geodemographic analysis doesn’t always mean that 
one will find what one expects to find, it certainly provides a 
GPS-type guide to those getting in their cars to go out and fix a 
problem. More to the point of developing comparative data indi- 
cators that address a policy priority, geodemographic analysis 
is appealing because it is built on relatively common definitions 
across borders. 
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Can We Fill the Spaces Between the Numbers? 

This essay makes a number of suggestions for reconstructing 
and filling in the spaces of our existing presentations of inter- 
national comparative data on higher education. Governed by 
principles of simplicity, “condensed comprehensiveness,” and 
meaningfulness, they include: 

• Setting one set of participation ratios to the reference point of 
a “qualifying” population, hence opening up the potential for 
improving flexibility indicators of later participation by the non- 
qualifying population. 

• As participation is the primary category under which inclu- 
siveness data can and should be set, international organiza- 
tions reporting comparative data should establish data and 
reporting standards for isolated populations, students with 
disabilities, and resident ethnic minority populations, along 
with a new set of parameters for reporting family income by 
national quintiles. 

• Establishing “penetrability” indicators of student movement 
from short-cycle to bachelor’s level and from bachelor’s level 
to graduate levels. 

• In tables marking attainment or graduation rates, including a 
marker indicating whether the country in question has imple- 
mented a Qualifications Framework (QF) for its degrees. 
National QFs are required under the Bologna Process, and 
OECD countries outside Europe (e.g., Australia) have devel- 
oped them as well. 

• Program delivery indicators marking the penetration of 
eLearning technologies. This is a complex but absolutely 
necessary territory that is absent from current reporting, and 
that will also prove to be a measure of inclusion. 



• While Eurostudent and Eurostat reporting have started to 
mark the volume of non-traditional points of entry to higher 
education (another part of the inclusiveness agenda), we need 
international negotiations to cover a wider range of pathways 
than currently employed. 

The United States is not exempt from these reforms, and, with 
respect to what we submit to the international organizations gener- 
ating comparative data tables, the following is suggested: 

• We send only system — and not institutional — graduation rates, 
and use our Beginning Postsecondary Students longitudinal 
studies for that purpose; and 

• More radically, re-scope all our sub-baccalaureate populations 
by program status under a revised ISCED system so that our 
wholly remedial students are classified as upper-secondary 
school and our workforce development certificate candidates 
are classified as “postsecondary-but-not-higher education.” The 
residual group would be considered true degree candidates, 
and that is the population of interest in international data. 

Not all questions concerning international comparative data 
on higher education are addressed in this report . 1 Issues such 
as comparative production of degrees, by discipline, were set 
aside for future investigation. And both systematic inclusion and 
scrutiny of higher education data from non-OECD countries are 
only a matter of time. ^ 



1 However, for deeper analysis see www.ihep.org/research/GlobalPerformance.cfm for a longer version 
of this essay and related materials. 
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Supplementary Online Material 

A longer and more detailed version of this essay can be found online at the IHEP Web site for the Global Performance project: 
www.ihep.org/research/GlobalPerformance.cfm. This web site also hosts additional information that was used in the course of 
this research, in a special folder labeled “International Comparative Data: Supplementary Material” that includes the following: 

1) Non-country-specific references. The references for both short and long versions of this essay are divided in two lists: 
country-specific and non-country specific. All country-specific documents consulted and/or cited in the text are to be found 
only online. 

2) Supplementary tables. These tables, on topics raised in the text, could not be included in the text without disrupting the 
flow of analysis. 



Abbreviations and Special Terms Used in the Text 



BFUG 


Bologna Follow-up Group 


EAG 


Education at a Glance 2008; annual report of comparative data from OECD 


EC 


European Commission 


EU 


European Union 


HEI 


Higher Education Institution 


IPEDS 


Integrated Postsecondary Education Data System (annual collection in the United States) 


ISCED 


International Standard Classification of Education 


LFS 


Labor Force Survey 


LIS 


Luxembourg Income Survey 


OECD 


Organization for Economic Cooperative Development 


Tertiary Education 


Higher Education 


UNESCO 


United Nations Educational, Scientific, and Cultural Organization 


UOE 


UNESCO, OECD, and Eurostat (as joint authors) 


5A 


ISCED category for bachelor’s degree programs and their equivalents 


5B 


ISCED category for associate’s degree programs and their equivalents 
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Introduction 



“First you have the natural numbers. The ones that are whole and positive. The numbers of a small 
child. But human consciousness expands. The child discovers a sense of longing. The negative 
numbers. The formalization of the feeling that you are missing something. ..and the child discovers 
the in between spaces. Between stones, between pieces of moss on the stones, between people. 
And between numbers. ..it leads to fractions. Whole numbers plus fractions produce rational 
numbers. And human consciousness does not stop there.. .it adds an operation as absurd as 
the extraction of roots. And produces irrational numbers. ..it’s a form of madness. ..and by adding 
irrational numbers to rational numbers, you get real numbers.. .and it doesn’t stop. It never stops.” 
— Peter Hoeg, Smilla’s Sense of Snow, pp. 121-122. 



So it is with numbers, and this essay will try to make sense of 
a series that never ends. It takes a critical stance toward the 
comparative international data on higher education that we 
currently possess and use, and, after considerable explication 
and analysis, makes some suggestions for rendering those 
data more convincing, more meaningful, more useful to higher 
education planners and policymakers, and less burdened by 
footnotes that are almost never read. 

This journey began with the Institute for Higher Education Poli- 
cy’s work on the massive restructuring of higher education 
across 46 nations in Europe known as the Bologna Process. At 
the end of that investigation 2 we were not alone in observing the 



2 For the most comprehensive of the results of this work, see Adelman C. 2009. The Bologna Process 
for U.S. Eyes: Re-learning Higher Education in the Age of Convergence at www.ihep.org/research/ 
GlobalPerformance.cfm. 



paucity and inconsistency of data on what would matter most to 
judging the success of the historic Bologna undertaking: what 
happens to students, both current and potential, and which 
countries were ahead of schedule, on-schedule, and lagging 
in producing the complex set of outcomes sought under the 
Bologna reforms. 

We then turned to the existing comparative international data 
on higher education, particularly as presented by the Organi- 
zation for Economic Cooperation and Development (OECD) 
in the well-known annual Education at a Glance ( EAG ), and 
also by the United Nations Educational, Scientific and Cultural 
Organization (UNESCO), World Bank, and Eurostat (the central 
statistics agency for the 27 countries of the European Union). 
Certainly, one would think, this international data could help fill 
in the blanks. 
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Instantly, the scope of the search encompassed countries 
outside of the Bologna Process, including the United States, 
and, simultaneously, involved data reports and online table 
generators from national statistical agencies and ministries, 
many of which are not presented in English. 3 There are 30 
countries in the OECD, 23 of which are also Bologna Process 
countries, so the overlap was felicitous to the inquiry. What, in 
brief, did we find? 

• A mess, and this essay will share the highlights of that mess; 

• Creative efforts by the international agencies to leap over the 
mess, but with problematic results, and this essay will share 
both the challenges to the international agencies and the fog 
they generate; 

• Misreading and misuse of the existing data on the attainment 
of the U.S. population and its students as presented in the 
international comparative accounts, particularly EAG 2008. 

Our focus and inquiry expanded, in turn, to larger questions 
concerning the quality, meaning, and use of international 
comparative data on higher education. This is not an academic 
exercise. 



3 With resident competence, translation assistance, and correspondence with colleagues abroad 
and officials at other nation’s ministries and statistical agencies, language was not an issue. For 
a list of those who kindly assisted, translated, and/or clarified terms and their application, see 
Appendix B. 



What Will This Essay Do? 

Departing from previous helpful work on this playing field (Kaiser 
and O’Heron 2005; Wellman 2008), this essay will: 

1. Offer some explanations concerning why all nations collect at 
least some data on basic higher education variables in the first 
place and why we try to compare those data. This discussion is 
grounded in consideration of economic rationales and the work 
of noted economists who have investigated relationships between 
education and macro-economic indicators. 

2 . Provide some serious consideration of demographic factors 
that should influence our interpretation of comparative higher 
education data. Population growth and decline is very much 
part of the background tapestry for interpreting population ratio 
presentations, and one does not need more than fourth grade 
mathematics to sober one’s interpretation of change or projected 
change. We will find, in the course of these considerations, why 
age is one of the most important variables in international higher 
education comparison, though one we hear little about from the 
U.S. commentariat. 

3. Review the basic terms, templates, and definitions used in 
comparative data statements about higher education, e.g., 
“what is ‘tertiary education’?” “What is a credential?” and “Who 
and what do we count?” These sound like easy questions. 
They aren’t. At the core of these difficulties lies a flawed inter- 
national classification system for academic programs and 
credentials called the International Standard Classification of 
Education (ISCED), the conundrums of which ripple throughout 
the analysis. 
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4 . Describe the sources and difficulties of the data used: reports 
and online table generators of national ministries and statistical 
agencies in 1 9 countries 4 and four international organizations that 
attempt to set common grids of reporting over the data produced 
by national ministries and statistical agencies, 5 even when the 
agencies themselves are not wholly happy with some of the 
reported results, a sentiment well reflected in EAG’s footnotes. 
Somewhere in the course of these explications, the reader will 
begin to experience numerical dizziness. 

5 . Indicate why ‘‘population ratios” (the percentage of a particular 
portion of national populations, e.g., 18-24 year-olds or 25-34 
year-olds) and “synthetic cohorts” (age groups built around theo- 
retical ages for higher education entry or completion) are used by 
OECD and UNESCO in particular, and then suggest the ways in 
which very basic demographic data should serve as a guide to 
interpretation of these ratios, particularly when time-series (e.g., 
“In 1995 it was X; in 2005 it was Y”) statements are at issue. 

6. Briefly review the effects of secondary school structures and 
pathways on tertiary participation. How does one represent and 

4 Australia, Austria, Canada, Denmark, Finland, France, Germany, Ireland, Italy, Japan, the Netherlands, 
Norway, Portugal, Spain, Sweden, Switzerland, Scotland, the rest of the United Kingdom (they have 
separate education authorities), and the United States. All of these are among the 30 core members 
of OECD, and all offer accessible data, whether in their native languages, English, or both. 

5 Eurostat, which covers the 27 countries of the European Union; the Organization of Economic 
Cooperation and Development (OECD), which covers 30 economically advanced democracies 
(and, occasionally, other “partner” countries), and both UNESCO and the World Bank, which 
cover everybody. 



fairly judge postsecondary access across systems with different 
structural lines, multiple types of secondary schools and what we 
would call “tracking” mechanisms? Secondary school filters are 
as important — and as overlooked — as student age in evaluating 
comparative higher education data. 

7 . Examine the definition of populations targeted to produce both 
(a) a more equitable distribution of participation and comple- 
tion, and (b) increased participation and completion. The United 
States is not alone in looking for and improving rates of access, 
participation, and completion among what we call “under-served” 
populations. How do we define those populations — and why? 
How do other nations define them — and why? There are consid- 
erable differences here, and we have something to learn from 
other countries on this account. 

8. This last item leads into our conclusions and recommenda- 
tions for what might produce more enlightening and construc- 
tive international data on higher education than those currently 
employed. Just as the 46 countries participating in the Bologna 
Process have worked toward a greater degree of “convergence” 
in structures and practices, so we look toward a greater degree of 
convergence in matters of the numbers that lie behind discourse 
in a world without borders. This essay is not alone in expressing 
these sentiments or suggesting alternatives: OECD’s Indicators 
of Educational Systems (INES) group is working to improve 
both the input data and indicator construction for both entry and 
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graduation rates; Eurostat is particularly self-reflective and self- 
corrective; and UNESCO, which crafted ISCED in 1997, is working 
on long-overdue revisions to that system. It’s not that we can 
tame numbers or that their frames and conditions are immutable, 
rather that we can all do better to shape them toward attainment 
of common ends, and to improve “the message content of statis- 
tical statements” (Gilomen 2002, p. 46). That’s the positive note 
on which this essay will finish. 

But Let Us Straighten Out the Core 
Propaganda Before We Begin 

An all-too-common rhetorical convention of reports and decla- 
rations on the status of U.S. higher education is to open with a 
statement that compares our participation and degree comple- 
tion rates to those of other economically advanced countries — 
and always to our disfavor. It’s a way to stir up the competitive 
juices: we have to be number one — or close to it — or, it is said, 
our future economic life is at risk. One can cite these reports and 
statements by the dozens — no, make it hundreds. 

Will it surprise anyone in the house that other countries with 
advanced economies utter similar statements and claim that 
the United States is ahead of them in higher education? For 
example, the European Commission (EC) has bemoaned the 
fact that the “average gross enrollment ratio” in higher educa- 
tion for 1 8-24 year olds in the United States is 81 percent versus 
52 percent in the European Union and 49 percent in Japan 



(European Commission 2005, p. 3). Setting aside for now what 
“gross enrollment ratio” means, the EC seems to be joining us 
in a rhetorical race to the bottom. 

This essay will not spend time addressing all the problems with 
this rhetoric or its problematic assumptions. We note only: (1) 
there are no longer rigid national borders in global economic life, 
so the notion of what the Japanese used to call ichi ban (number 
one) is rather passe; in fact, if other countries are doing better 
than previously, then we all are doing better; (2) economists 
have presented a mixed judgment of the relationship between 
national levels of education, on the one hand, and productivity, 
productivity growth, and economic growth, on the other, and 
we ought to be more modest in our claims; (3) the idea of one 
country “ranking” higher than another (even when the differ- 
ences are negligible and statistical significance impossible to 
prove, e.g., 42 percent of something versus 39 percent) is a moot 
exercise; 6 and (4) among advanced post-industrial democracies, 
the country with one of the lowest levels of higher education 
attainment, Germany, maintains a fairly robust economy, even 
in our difficult times. One does not need more than a degree in 
common sense for these observations. Enough said. ^ 



6 The education portion of the United Nations' Human Development Index (HDI) is even more egre- 
gious on this count with scores ranging from 0.946 to 0.993 for its top ranked nations. We’re not 
sure what these scores mean and whether the differences are either statistically or substantively 
meaningful. The United States, by the way, is “ranked" 5 th — whatever that means. Do we brag that 
our 0.971 “beat” Russia’s 0.956? Or, weep that it “lost” to Korea’s 0.980? 
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Numbers 



From every corner of the U.S. policy world it has been declared that we have “fallen” in our 
international position in higher education from 1 st to 7 th or 10 th or some other dismal rank in the 
universe of 30 advanced post-industrial democracies that are members of OECD, and that the 
attainments of our younger generations do not match those of their elders. The metrics on which 
this collapse has taken place, it is said, run from access to completion rates, and particularly the 
latter. The claimants base their assertions — so they say — on the bible of international education 



data comparisons, OECD’s annual EAG. 

But as soon as one opens the printed 2008 edition of EAG and 
reads the tables for a core issue — such as the percentage of 
the population that has earned higher education credentials — it 
is obvious that the claims are rather problematic in the context 
of normal U.S. discourse on these matters! 

This essay refers to the printed versions of Education at a 
Glance, not the online “Whoops! We made some mistakes” 
versions issued, without fanfare, three months later. The printed 
versions, after all, are what moves messages immediately into 
the propaganda environment. 



7 The title of the table, “Population that has attained tertiary education,” is somewhat ambiguous. The 
data come from each country’s labor force survey under what are called UOE rules, and can include 
tertiary credentials earned-but-not-awarded. Some national system data reports, e.g., Sweden, make 
this distinction, e.g., students who have completed the requisite credits but who have yet to pass 
their final, degree-qualifying assessments. 



Take, as the primary case, the presentation of the highest 
credential earned by age group (EAG 2008, Table A1 .3a, p. 
44) . 7 In our normal discourse, a “college degree” equals the 
bachelor’s, and bachelor’s degree attainment rates are the 
Dow Jones Industrial Average of U.S. higher education. In Table 
A1 .3a, this level of attainment is referred to as “Tertiary-type A 
and Advanced research programs,” i.e., bachelor’s and higher. 
EAG presents these by what this essay calls a “census population 
ratio.” By age bracket and percentage of the population within 
that bracket who had earned at least a bachelor’s degree by 



8 This essay was written prior to the release of the 2009 edition of EAG, which repeats this table using 
2007 data. Using printed versions of EAG only, the U.S. percentages change so dramatically (e.g., 
from 33 to 30 percent of the 55-64 age group; from 34 to 30 percent of the 45-54 age group; from 
36 to 33 percent of the 35-44 age group) that one would think our bachelor’s degree holders (the 
numerator) are dying at rates far above the rest of the population or that we experienced a massive 
immigration of unschooled middle-aged people (the denominator) in 2007-or both. The table has 
us tied for 7 th place with Sweden and Australia at 31 percent, just below a group of Bologna coun- 
tries (Denmark, Finland, the Netherlands), which had changed over to the new three-year degree 
cycles. As this essay notes below, our 2008 position is not likely to last-and the reasons are obvious: 
demography and Bologna. 
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TABLE 1 



U.S. Rank Among 30 OECD Countries in the Proportion of the Population with Bachelor’s 
or Higher Degrees, by Age Bracket, 2006 

AGE 55 TO 64 AGE 45 TO 54 AGE 35 TO 44 AGE 25 TO 34 

Proportion of U.S. population with bachelor’s or higher degree 33% 34% 36% 35% 

Rank 1 st 1 st 1 st 2 nd 

SOURCE: OECD, EDUCATION AT A GLANCE 2008, TABLE A1.3A (P. 44) 



2006, a second grader could read Table A1 .3A and see the U.S. 
rank among the 30 OECD countries as is displayed in table i . 8 
By what perverse alchemy do we convert this to decline and 
dissolution? 

Other countries’ statistical reports can read this annual column 
very clearly (e.g., Swiss Federal Statistical Office 2006; Bradley 
et al [Australia] 2008), but our commentariat does not bother to 
read it at all. The drum-pounders prefer to ignore our conven- 
tional reference points, tossing out the Dow Jones, and replacing 
it with another column in Table A1.3a: a column including all 
degrees awarded, including sub-baccalaureate credentials, 
particularly associate’s degrees. 

Not all OECD countries’ higher education systems grant sub- 
baccalaureate degrees. When they do, the degrees are gener- 
ally called “short-cycle” and are labeled within the traditions of 
the country at issue. Some are offered by the same institutions 
that grant the equivalent of bachelor’s degrees (e.g., the hoge- 
scholen in the Netherlands); some are considered part of the 
bachelor’s degree. In England, the Foundation Degree is offered 
jointly by universities and Further Education Colleges; in France, 
the short-cycle Diplome universitaire de technologie (DUT) is 
offered by institutions that are married to universities across the 
street. The production of these degrees is particularly strong in 
Belgium, Canada, France, Japan, Korea, New Zealand, and a 



half dozen others, powered by institutions whose principal job 
is to produce those credentials. OECD is very explicit about this, 
though our avatars of grief choose not to pay attention. They 
engage in what economists call “confirmation bias,” selecting 
evidence that supports what they want to believe or juggling 
statistics until they yield an answer that confirms their beliefs. 
Why do they want to believe that the United States is doing 
poorly in higher education and using degree production as the 
measure? To rouse us from an otherwise complacent sleep? 
We’ll leave that speculation for another day. 

The production of sub-baccalaureate degrees is particularly 
weak in the United States, primarily because their principal 
agent, the community college, has taken on many tasks that 
comparable institutions in other countries have not assumed, 
and is under more pressure to facilitate transfer to a four-year 
college than to generate associate’s degrees. Thus, Hauptman 
and Kim (2009) argue for greater degree production by our 
community colleges as the principal route to raising our 
composite international position in attainment. That argument 
is beside the point here, but there is no question that if our sole 
interest was in producing more degrees for the sake of a ranking 
in Table Al ,3a of EAG 2008, we would forget bachelor’s degrees 
and push hard at the associate’s level. This essay does not deal 
in such proposed reconstructions: it is sharply focused on the 
data itself and its contexts. 
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Note: For purposes of this initial air cleaning in the face of nega- 
tive propaganda, the validity of the census population ratio as a 
method of international comparison is provisionally 
accepted. By the time this essay concludes, the reader should 
consider these ratios — and the ranking statements to which 
they lead — to be but fractional measures of human capital. The 
standings of athletic teams offer more content. 

So if we are to quote the bible of comparative international 
data to assess our national standing, let’s get the chapter 
and verse correct and clear: 

• The United States does very well with population ratios 
of bachelor’s degree attainment; in fact, at least for 
now , ranks rather high; 

• The United States does not do very well with popula- 
tion ratios covering all undergraduate higher education 
credentials. 



The second charge leveled against U.S. higher education, and 
on the basis of a table in EAG 2008, at least focuses wholly 
on the Dow Jones Industrial Average of higher education: our 
macro bachelor’s degree completion rate, compared with those 
of other countries, is miserable! Let us grant that we can — 
and should — do better, regardless of what other countries do. 
But this is a more complex case, and one that reveals some 
“prejudices” in OECD’s presentation. 



The methodology that brings us closest to details of student 
pathways is the longitudinal study, which stripped of all its other 
knowledge, and converted to the job of generating a comple- 
tion rate indicator, is what shorthand calls a “cohort survival” 
account. Drop-out studies (e.g., Heublein, Schmelzer, and 
Sommer 2005 for Germany; Morgan, Flanagan and Kellaghan 
2001 for Ireland), don’t wholly do the job because they are 
confounded by stopouts, transfers, and “return rates,” and 
not all national statistical agencies have such variables in their 
portfolios. So OECD tries a different approach, and presents 
its account in EAG 2008 in Table A4.1 (p. 98) for 24 member 
countries and three others. Despite its potential, we are staring 
at an unfortunately mysterious and puzzling ledger for a number 
of reasons: 

• Of the 24 OECD accounts, 12 are cross-sectional, hence what 
are called synthetic age ratios. In such accounts, the people 
completing degrees in year X (the numerator) are not neces- 
sarily those who started out in tertiary education in year Y (the 
denominator), year Y being X minus the theoretical time to 
degree assuming full-time attendance. The other 12 accounts 
are “true cohorts,” i.e. , either a full census or representative 
sample (“panels”) of beginning tertiary students in a given 
year who are followed to a censoring year. The U.S. data, from 
our Graduation Rate Survey , 9 represent a “true cohort.” 



9 The Graduation Rate Sun/ey is part of the National Center for Education Statistics’ Integrated Post- 
secondary Education Data System (IPEDS). 
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